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In this paper we propose, discuss and illustrate a computationally feasible definition of chaos which can be 
applied very generally to situations that are commonly encountered, including attractors, repellers and non- 
periodically forced systems. This definition is based on an entropy-like quantity, which we call “expansion 
entropy”, and we define chaos as occurring when this quantity is positive. We relate and compare expansion 
entropy to the well-known concept of topological entropy, to which it is equivalent under appropriate con¬ 
ditions. We also present example illustrations, discuss computational implementations, and point out issues 
arising from attempts at giving definitions of chaos that are not entropy-based. 


Toward the end of the 19th century, Poincare 
demonstrated the occurrence of extremely com¬ 
plicated orbits in the Newtonian dynamics of 
three gravitationally attracting bodies. This com¬ 
plexity is now called chaos and has received a vast 
amount of attention since Poincare’s early dis¬ 
covery. In spite of this abundant past and cur¬ 
rent work, there is still no broadly applicable, 
convenient, generally accepted definition of the 
term chaos. In this paper, we advocate a par¬ 
ticular entropy-based definition that appears to 
be very simple, while, at the same time, is read¬ 
ily accessible to numerical computation, and can 
be very generally applied to a variety of often- 
encountered situations, including attractors, re¬ 
pellers, and non-periodically forced systems. We 
also review and compare various previous defini¬ 
tions of chaos. 


I. INITIAL DISCUSSION 

While the word chaos is widely used in science and 
mathematics, there are a variety of ways of defining 
it. Thus, for this 25th anniversary issue of the journal 
CHAOS, we are motivated to review issues that arise 
when attempting to formulate a generally applicable def¬ 
inition of chaos, and to advocate a particular entropy- 
based definition that seems to us to be especially apt. 
We also relate our proposed definition to previous defini¬ 
tions. 

Intuitively, perhaps the two most prominent (not nec¬ 
essarily independent) attributes of what scientists com¬ 
monly think of as chaos are the presence of complex or¬ 
bit structure and extreme sensitivity of orbits to small 
perturbations. Indeed, in the paper by Li and Yorkd-^ 
where the term chaos was introduced in its now widely 
accepted nonlinear dynamics context, the term was mo¬ 
tivated by the simultaneous presence of unstable periodic 
orbits of all periods, as well as an uncountable infinity of 
non-periodic orbits. Thus, Li and Yorke’s introduction 
of this terminology was motivated by the chaos attribute 
of complex orbit structure. On the other hand, Lorend® 


was concerned with weather forecasting and accordingly 
focused on the chaos attribute of temporally exponential 
increase of the sensitivity of orbit locations to small initial 
perturbations. As we will discuss, these two attributes 
can be viewed as “two sides of the same coin”. 

We think of a definition of chaos as being “good” if it 
conforms to common intuitive notions of chaos (such as 
complex orbit structure and orbit sensitivity) and, at the 
same time, has the following three desirable features: 

• Generality. The definition should work for almost 
all the examples that typical readers of this journal 
are likely to judge as chaotic. 

• Simplicity: The definition should be fairly concise 
and not too technical. 

• Computability : The definition should allow a prac¬ 
tical, straightforward computational implementa¬ 
tion for discerning the existence of chaos in a model. 

Considering the issue of generality, one would like a 
definition of chaos to be applicable not only to attrac¬ 
tors, but also to non-attracting sets, often called re¬ 
pellers. With respect to chaotic repellenP®, we no te 
that they are central to the physically relevant topics of 
fractal basin boundaries, chaotic transients, and chaotic 
scattering, occur ring , for example in fluid dynamic^ 9 , 
celestial mechanics®, chemistry-®, and atomic physics-®. 

Furthermore, again considering the issue of general¬ 
ity, due to their common occurrence in applications, 
we desire that our definition of chaos be applicable to 
non-autonomous dynamical systems (i.e., systems that 
are externally forced by time dependent inputs), includ¬ 
ing external inputs that are temporally quasi-periodic®, 
stochastic®*-®, or are themselves chaotic. Here physical 
examples include quasi-periodic forcing of atmospheric 
jets® quasi-periodic forcing of stellar luminosity vari¬ 
ation by two superposed stellar modal oscillation^-®-®, 
advective transport in fluids with temporally and spa¬ 
tially irregular flow fields 20 "®, and phase synchronism of 
chaos by noisy or chaotic drived®. We emphasize that, 
when considering externally forced systems, we are inter¬ 
ested in identifying chaos in the response of the system 
to a particular realization of the forcing, not in charac¬ 
terizing whether the forcing is chaotic. 
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An important point for consideration of non- 
periodically forced chaotic systems is that the notion 
of a compact invariant set, which is typically used in 
definitions of chaos for autonomous systems (including 
Poincare maps of periodically forced systems), may not 
be appropriate or convenient for situations with non¬ 
periodic forcing. Furthermore, in practice, it may be 
difficult to locate or detect an invariant set that is not an 
attractor. Thus, rather than defining chaos for an invari¬ 
ant set, we will instead consider a notion of chaos for the 
dynamics within any given bounded positive-volume sub¬ 
set S of the state space. We call such a set S a restraining 
region. For autonomous systems, chaos for an invariant 
set can be detected by taking S' to be a neighborhood of 
the desired invariant set. 


In our opinion, the currently most satisfactory way of 
defining chaos for autonomous systems is by the exis¬ 
tence of positive topological entropy or metric entropy. 
We note, however, that the standard definitions of these 
entropies are quite difficult to straightforwardly imple¬ 
ment in a numerical procedure. In addition, while gen¬ 
eralizations to the original definitions of topological and 
metric entropy have been proposed, we view it as desir¬ 
able to have a relatively simple definition that is appli¬ 
cable very broadly. However, we do not address here the 
question of identifying chaos in experimental data, which 
presents additional challenges, especially in the cases of 
non-attracting sets and externally forced systems. 


Motivated by the considerations above, in Sec. |TT] we 
introduce and discuss the definition of an alternate en¬ 
tropy quantity that we call “expansion entropy”. The 
expansion entropy of an n-dimensional dynamical sys¬ 
tem on a restraining region S is the difference between 
two asymptotic exponential rates: first, the maximum 
over d < n of the rate at which the system expands d- 
dimensional volume within S; and second, the rate at 
which n-dimensional volume leaves S (this rate is 0 for 
an invariant set). We define chaos as the existence of 
positive expansion entropy on a given restraining region. 
Expansion entropy generalizes (to nonautonomous sys¬ 
tems and noninvariant restraining regions) a quantity 


that was formulated by Sacksteder and ShutM* 1 in the 
case of an autonomous system on a compact manifold. In 
this restricted case, by the results of KozlovskP-; expan¬ 
sion entropy is equal to topological entropy for infinitely 
differentiable maps. In Sec. |III| we present examples of 
the application of our definition of expansion entropy to 
various systems, and also provide illustrative numerical 
evaluations of expansion entropy for some of these exam¬ 
ples. Section IV discusses topological entropy and pre¬ 
vious work on computation of this quantity. Section [V] 
discusses issues that arise in previous non-entropy-based 
definitions of chaos. 


II. EXPANSION ENTROPY 
A. Definition 


Our definition of expansion entropy, which we denote 
Hq, is closely related to previous definitions of topolog¬ 
ical entropy, to which it is equivalent under appropri¬ 
ate conditions (see Sec. IV). Expansion entropy uses the 
linearization of the dynamical system and a notion of 
volume on its state space; thus, unlike topological en¬ 
tropy, it is defined only for smooth dynamical systems. 
On the other hand, expansion entropy does not require 
the identification of a compact invariant set. As we will 
discuss, the differences in the definitions may make the 
criterion Hq > 0 attractive as a general definition of chaos 
in smooth dynamical systems. 

We assume that the state space of the dynamical sys¬ 
tem is a finite-dimensional manifold M. (For example, 
if the manifold M is n-dimensional Euclidean space, the 
state a; at a given time is a vector [x\,X 2 , ■ ■ ■, x n ] where 
each Xi is a real number. If some of the coordinates are 
angle variables, they can be taken modulo 27r, result¬ 
ing in manifolds such as a circle, cylinder or torus.) We 
write p{S) for the volum^^of a subset S of M , and write 
dp,(x) for integration with respect to this volume; for n- 
dimensional Euclidean space, one can take dp,(x) = d n x. 
Given a dynamical system on M. we will use an integral 
to define its expansion entropy on a closed subset S (the 
restraining region) that has positive, finite volume. The 
set S need not be invariant under the system. 

We consider a deterministic dynamical system to be 
defined by an evolution operator, by which we mean a 
family / of maps / t q t '■ M —> M, with the interpretation 
that if x and x' are the states of the system at times t 
and t ', respectively, then x' = ft',t(x )■ (For example, ft',t 
could represent the solution from time t to t' of a system 
of differential equations.) The family / must satisfy the 
identities / M (x) = x and f t ",t(x ) = ft",t'{ft',t{x)). The 
maps ft'.t are defined for t\t being integer-valued (dis¬ 
crete time) or being real numbers (continuous time), with 
the restriction that t' > t if the system is noninvertible. 
We allow the system to be nonautonomous, including the 
case where fr.t is a realization of a stochastic dynamical 
systemPillf the system is autonomous, then f t ^ t depends 
only on t'—t, and in this case we will often write ft\t = /t 
where T = t' — t. Regardless, we assume that f t > t is a 
differentiable function of x. 

Recall that the singular values of a matrix A are the 
square roots of the eigenvalues of A T A. Thinking of A as 
a linear transformation, the image of the unit ball under 
A is an ellipsoid, and the singular values of A are the 
semiaxes of this ellipsoid. Let G{A) be the product of 
the singular values of A that are greater than 1; if none 
of the singular values are greater than 1, let G{A) = 1. 
Then G(A) is roughly the number of e-balls needed to 
cover the image of an e-ball under A. 

If the matrix A is n x n, consider a d-dimensional plane 
Pd in n-dimensional Euclidean space, where d < n. Let 
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W be a d-dimensional ball in Pd, let A(W) denote the 
image of W under A, and let denote d-dimensional 
volume. Then G(A) is the maximum over orientations 
of Pd and over d of pd(A(W))/pd(W). Thus, G(A) is 
the largest possible growth ratio of d-dimensional volumes 
under A. Below we will apply G to the derivative matrix 
Df t ’ t , in which case it represents a local volume growth 
ratio for the (typically nonlinear) map ft'.t- 

Let S t \t be the set of x such that ft",t(x) G S for all 
t" between t and t' (that is, the trajectory of x from t to 
t' under / never leaves S). Let 

e ^ s) = W)L w 

Definition of expansion entropy: We define the 
expansion entropy Ho to be 

JJ ft c\ V In E tl> t(f,S) 

H 0 (f,S)=hm --—--. (2) 

£'—>■00 t — t 


We consider H 0 and other limiting quantities below to be 
well-defined only if the limit involved exists.® We remark 
that if the system / is nonautonomous and the restrain¬ 
ing region S is not invariant, Ho(f,S) could potentially 
depend on the starting time t in addition to / and S. 
Also, it can be shown that the value of Hq is invariant 
under differentiable changes of coordinates that are non¬ 
singular on S. 

To help interpret the definition of Hq (/, S) , we now 
replace 1 / ji{S) with [l//x(5 t / jt )] ,t) / ^{S)\ in Eq. <[T|). 

The definition © can then be expressed as 


H 0 (f, S) 


lim 

£'->-oo 


In E t . tt (f,S) 
t> -t 


1 

5 

T+ 


( 3 ) 


where 


J_ _ lim MM-SOM-SV,*)] 

T_|_ £'—>■ oo V — t 


( 4 ) 


It can be shown that the exponential growth rate of 
G(Df t >,t(x)) as t! —\ oo is the sum of the positive Lya¬ 
punov exponents of the trajectory starting at x at time 
t. Thus, the limit in Eq. © is, in a sense, an average of 
this sum of positive Lyapunov exponents over trajecto¬ 
ries that remain in S for all (forward) time. The criterion 
H 0 > 0, which we propose for defining chaos, requires 
that this exponential volume growth rate strictly exceed 
the exponential rate 1/t+ at which trajectories leave S. 
Note that if S is forward invariant, e.g., an absorbing 
neighborhood of an attractor, then l/r + = 0. 

Some points of interest for this entropy definition are 
that 


(i) it applies to non-autonomous systems, 

(ii) it assigns an entropy value Hq to every restraining 
region S in the manifold M, and 


(iii) it directly suggests a computational technique for 
numerically estimating Hq (see Sec. IIC). 


Finally, notice that 

Ho(f,S')<Ho(f,S)i{S' CS. (5) 

This property follows from the fact that S[, f C S t \t 
if S' C S, and consequently E t > tt (f,S') < E t ’,t{f,S). 
Thus, if there is chaos according to the definition H 0 > 0 
with respect to a restraining region S', then there is also 
chaos with respect to every restraining region S that con¬ 
tains S' . In particular, as illustrated by the example in 
Sec. |III B| this implies that the expansion entropy will de¬ 
tect chaos (H 0 > 0) within a restraining region S when 
S also contains a nonchaotic attractor, even when the 
chaos exists only on a repeller. 


B. Expansion Entropy of the Inverse System 


and 


H t ', t (f,S) = ——=7—r f G(Df Vit (x))d^x). 

J S t ! 

Thus, we can view Ho(f, S) as the difference of two expo¬ 
nential rates, given by the limits in Eqs. <[3j) and Q, with 
the following interpretations. Imagine that N initial con¬ 
ditions are uniformly sprinkled throughout the volume of 
S at time t, and that N is very large (N — > oo). The sec¬ 
ond term l/r+ in Eq. (J3| is then the exponential decay 
rate, as t! increases, of the number of trajectories from 
these initial conditions that remain in S for all times be¬ 
tween t and t'. The quantity E t ',t(f,S) is the average 
over these remaining trajectories of the maximum local 
d-dimensional volume growth ratio along the trajectory. 
Thus, the first term in Eq. (|3j) is the exponential growth 
rate of this average. 


In this section, we show that the expansion entropy of 
an autonomous, invertible system is the same as the ex¬ 
pansion entropy of the inverse system. (Note that this is 
also true for the topological entropy; see Sec. IV ) This 
equality results from the following identity for all invert¬ 
ible systems (not necessarily autonomous): 


E t MS) = E t , >t (f,S). 


To verify this identity, notice that f t t ' is the inverse of 
ft’d- Below we use the notation x’ = ft’,t{ x ), and conse¬ 
quently x = ft, t >(x '). Then Df t d’{x') and D/ t / jt (x) are 
inverses, and hence the singular values of Df t t ’(x') are 
the inverses of the singular values of Df t >d(x). Since 
the product of the singular values of a square ma¬ 
trix is the absolute value of its determinant, if A is 
invertible then |detA| = G(A)/G(A -1 ). In particu¬ 
lar, | det Df t 'd(x)\ = G{Df t ’d(x))/G(Df t d’{x')). Also, 
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ft',t{S t ',t) = S t ,t>. Writing E t , t >(f,S) as an integral over 
x' and then making the change of variables x' = 

Et,v (/, S ) = J^S)J S om, {x'))d^x') 

= J s G(Dft,t'(x'))\detDf t ,, t {x)\dfj,{x) 

= Ji(s) Is G( ^ D M X ))M X ) = s )- 

If / is autonomous and invertible, we write f t '.t = ft'-t 
and 1 = f-T ■ Then 

Ho(f-\S) = lim ln[E T ,oU~\S)]/T 

T—yea 

= lim ln[£_ r , 0 (/,S)]/T 

T-y oo 

= lim ln[£ 0 ,_T(/,S)]/T 
T—yea 

= lim HErAf,S)]/T = H 0 (f,S) 

T—yea 

Here the first equality is by definition, the second equality 
is a change of notation, the third equality follows from 
the time-reversal identity for E derived above, and the 
fourth equality uses the fact that / is autonomous. 


C. Discussion of Numerical Evaluation of Expansion 
Entropy 


With respect to point (iii) in Sec. IIA we can imag¬ 
ine a computation of H 0 proceeding as follows. First, 
randomly sprinkle a large number of initial conditions 
{xi,X 2 , ■ ■ ■ ,£at} uniformly in S. Then evolve each tra¬ 
jectory frfiixi) and the corresponding tangent map 
Dfrfiixi) forward in time, continuing to evolve only as 
long as the trajectory remains in S. At a discrete se¬ 
quence of times T, compute 


N 


E T (f,S) = N~ 1 Y / ' G(D/ r ,„(*<)), 


( 6 ) 


i=1 


where the prime on the summation symbol signifies that 
only those i values for which fT,o{%i) remains in S up 
to time t are included in the sum. From our definition 
of E in Eq. |l]), we see that Ej-ifyS) is an estimate of 
Et, o(/, S). Plotting In Er(f, S) versus T, for sufficiently 
large N and T, we expect to find an approximately linear 
relationship. Accordingly, we can estimate Hq as the 
slopejrf a straight line fitted to such data (see also Jacobs 
et alps for a similar approach in two dimensions). 

As in other such procedures, judgment and experimen¬ 
tation are called for in determining reliable choices of N 
and the range of T over which to do the fit, and such 
choices will be constrained by computer resources. In 
practice, we find it useful to choose a number, say 100, of 
different samples of size N, compute hi -&r(/, S) for each 
sample, and take the mean and standard deviations of 


these logarithms. Not only does this allow us to estimate 
the sampling error, it also produces a more reliable mean 
estimate than computing In Er(f, S) for a single sample 
of lOOiV points. Example illustrations of this computa¬ 
tional approach are given in Secs. Ill B III C[ and III E 


Specializing to the case of an autonomous invertible 
system /, since Sec. |IIB| shows that the expansion en¬ 
tropy of / and / -1 are the same, one could do a nu¬ 
merical computation of Hq using either / or / -1 . The 
question then arises as to which of these two alternatives 
is preferable from the point of view of computational cost 
and accuracy. In the remainder of this section, we argue 
that it is computationally preferable to calculate Hq from 
/ if / is volume contracting in S, while calculation from 
/ _1 is preferable if / is volume expanding in S. In order 
to see this, we generalize Eq. Q to define both forward 
and backward exponential decay rates 


— = lim ^hi[//(S)///(S ±T ,o)] (7) 

T± T-y oo 1 


where S±t o is, as in Sec. IIA the set of initial conditions 


at time 0 whose trajectories under / remain in S between 
times 0 and ±T, respectively. That is, in terms of the 
previously stated numerical procedure for calculating the 
expansion entropy, 1 /t+ is the exponential temporal de¬ 
cay rate of the number of initial conditions sprinkled uni¬ 
formly throughout S at time 0 that lead to orbits that 
never leave S up to time T, while l/r_ is the analogous 
quantity taking the initially sprinkled points backward 
from time 0 to time —T. Since, to estimate the inte¬ 
gral in Eq. ([l]), we need to compute the average expan¬ 
sion rates only from those initial conditions that have not 
left S, statistics at any given T are improved when the 
number of such orbits is largest. Further, the estimate 
of the limit T —> +00 dictates that we make T large. 
These two considerations indicate that the forward (re¬ 
spectively, backward) calculation of Hq will be computa¬ 
tionally more efficient if r+ > r_ (respectively, t_ > t+). 
Subtracting the definition 0. of 1 /t + from the definition 
of 1 /t_, and using the fact that S-t, 0 = /r,o(<Sr,o) for 
an autonomous invertible system, we obtain 


( 1 / T +) - (V T -) = lim 7T ln{/u(/r,o(-S , T,o))/M(‘S , T,o)}- 

1 —too 1 


The right hand side is positive (respectively, negative) 
when the map is volume expanding (respectively, con¬ 
tracting) in S. Thus, r_ > r+ if the map is volume ex¬ 
panding, while t_|_ > r_ if the map is volume contracting. 
In particular, if S' is a neighborhood of an attractor, it is 
best to employ a forward time calculation. We note that 
the common examples of the Henon map and the Lorenz 
system are uniformly volume contracting at all points in 
state space (implying that r + > r - ), while Hamiltonian 
systems are volume preserving (implying that r + = t~ ). 
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D. Generalization to q-order expansion entropy 

In past work on fractal dimension, the box-counting 
dimension has been generalized to a spectrum of di¬ 
mensions often denoted D qi where the box-counting di¬ 
mension corresponds to q = 0 , and the index q can 
be any nonnegative numbeF^HSll. I n addition, a spec¬ 
trum of entropy-like quantities, again depending on an 
index q > 0, has been introduced by Grassberger and 
ProcaccicP® 5 !, where q = 0 corresponds to the topologi¬ 
cal entropy, and q = 1 corresponds to the metric entropy. 
Thus, motivated by these past works, it is natural to in¬ 
troduce an analogous spectrum of g-order expansion en¬ 
tropies, H q , and to consider whether they are useful with 
respect to the issue of defining chaos. 

In Appendix|Aj we introduce and discuss a natural way 
of specifying H q . In particular, the form defining H q is 
specified so that it gives Eqs. ([!]) and (J2| when q = 0, 
gives an expansion entropy analogue of the entropy of 
Grassberger and ProcaccicP®^, and also gives a corre¬ 
spondence for q = 1 with previous results for the metric 
entropy of repcllerP^ and with Pesin’s formula®'Ifor the 
metric entropy for attractors. However, as we will argue 
in Appendix [Aj q = 0 is special in regard to defining 
chaos. In particular, Appendix [A] will consider H q for 
an example in which S contains an attracting fixed point 
and a chaotic repeller (see Sec. |mB| ). For this example, 
it is shown that H 0 > 0, while H q for q > 0 can be zero. 
Thus, H 0 successfully detects the chaos within S, but H q 
for q > 0 may not. 

III. ILLUSTRATIVE EXAMPLES 



FIG. 1. A map illustrating a case where S = [—1,1.5] contains 
a chaotic repeller (in S' = [0,1]) and an attracting fixed point 
(x = - 1 / 2 ). 

Once again, H 0 (f, S ) = 0. 

For fixed points (or periodic orbits) of higher¬ 
dimensional systems, similar arguments can be made, 
though they are more complicated in the case when the 
fixed point has both stable and unstable directions. The 
essence of these calculations is that any growth in the in¬ 
tegrand G of Eq. ([I]) as t' — t increases is balanced (up to 
a time-independent multiplicative constant) by a reduc¬ 
tion in the volume of Spy- The conclusion remains that 
Hq = 0 , i.e., that isolated period orbits are not chaotic. 


A. Attracting and repelling fixed points 


Consider a one-dimensional differentiable map / with 
a fixed point Xo ; for simplicity, we assume that Df(x o) 7 ^ 
± 1 . Let the restraining region S be an interval containing 
Xq on which \Df(x)\ 7 I 1 ; that is, / is either uniformly 
expanding or uniformly contracting on S. In either case, 
we show below that the expansion entropy Ho(f,S ) is 
zero, i.e., that fixed points are not chaotic according to 
our definition. 

In the case of an attracting fixed point, |U/ t / ;t (a:)| < 1, 
and hence G{Df t ^ t {x)) = 1 , for all x £ S and t ’ > t. 
Also, S t >.t = S for t' > t. Then from Eq. (fl| and Q we 
have S) = /j,(S ) for t' > t and Ho{j7S) = 0. 

In the expanding case, \Df t ^t{x)\ > 1 for trajectories 
that remain in S from time t to t 1 . Also, St\t is a subin¬ 
terval of S whose endpoints map to the endpoints of S 
under f t / t . Thus, 


E t’A f >S) = j^Js \Df Vl t(x)\dx 

1 

t*(S) 


Df t ',t{x)dx 


= 1 . 


B. Example: A one-dimensional map with a chaotic 
repeller and an attracting fixed point 

Consider the one-dimensional map / shown in Fig. [l] 
and the two restraining regions S and S' £ S, where we 
take S = [—1,1.5] and S' = [0,1]. The map is linear with 
derivative 3 on [0,1/3] and linear with derivative —2 on 
[1/2,1], mapping each of these intervals to [0,1]. For this 
example, the fixed point x = — 1/2 attracts almost all 
initial conditions with respect to Lebesgue measure in S. 

On the other hand, S' contains an invariant Cantor 
set that is commonly called a chaotic repeller. We now 
show that according to our definition, / exhibits chaos 
by having positive expansion entropy Hq in both S and 
S'. The invariant Cantor set consists of all initial con¬ 
ditions in [ 0 , 1 ] whose trajectories never land in the in¬ 
terval (1/3,1/2), i.e., those whose base 6 expansion does 
not contain the digit 2. The set 5 / 0 of initial condi¬ 
tions whose trajectories remain in [ 0 , 1 ] from time 0 to 
time T consists of 2 T intervals corresponding to all pos¬ 
sible strings of length T of the letters L and R, where 
L denotes an iteration in the interval [0,1/3] and R de¬ 
notes an iteration in the interval [1/2,1]. A string with 
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k L’s and T — k i?’s corresponds to an interval of length 
3~ k 2 k ~ T , on which Df T = 3 fc (— 2) T ~ k . Then the inte¬ 
gral of G(Df T ) = \Df T \ on each such interval is 1. Thus, 
Er,o{f,S') = 2 T , and hence H 0 (f,S') = ln2. In accor¬ 
dance with property ([5|, since S contains S', we also have 
H 0 (f,S) = \n2. 

In Appendix |Aj in addition to defining the quantity 


Hq discussed in Sec. 


IID 


we also evaluate H q for the 


map in Fig. [l] We find for the smaller restraining re¬ 
gion S' that H q (f,S') > 0 for all q > 0, but for the 
larger restraining region S there is a critical value q c < 1 
such that H q (f,S) = 0 for q > q c . For q = 1, we 
have Hi(f, S') = (2/5) ln(5/2) + (3/5) ln(5/3) > 0, while 
Hi(f, S) = 0. Our interpretation is that H\{f, S) is dom¬ 
inated by the dynamics of Lebesgue almost every initial 
condition whose trajectory approaches the fixed point at¬ 
tractor, while H 0 (f,S) is dominated by the chaotic sad¬ 
dle in S'. We therefore conclude that Hi (and similarly 
H q for <7 > 0) is not an appropriate tool for detecting 
non-attracting chaos in a restraining region. 

Next we use this example to illustrate the numeri¬ 
cal computation of Hq. Our procedure, as explained in 
Sec. |IIC[ is to choose a sample size N and range of T 
values and to do the following for each T. Using Eq. Q, 
we compute an estimate Et of Et ,o for each of 100 dif¬ 
ferent samples of N points each in the restraining region, 
and compute the mean and standard deviation of the 100 
samples. The results for N = 1000 and N = 100,000 are 
shown in Fig. [2] for S' and in Fig.[3]for S. The estimated 
value of Hq is the slope of the solid curve in an appropri¬ 
ate scaling interval. The scaling interval for a given N 
can be judged by consistency of the results with a larger 
value of N, in addition to smallness of the error bars and 
straightness of the curve. Notice that the somewhat arbi¬ 
trarily chosen restraining region S yields nearly as long a 
scaling interval as the restraining region S' that is chosen 
with knowledge of the invariant Cantor set. 


C. Example: A random one-dimensional map 

Consider the one-dimensional random map 


N = 1000 



N = 100000 



FIG. 2. Computation of In At versus T for the map of 
Fig; a with restraining region S'. For each T, we computed 
In Er(f,S') for 100 different samples, with N = 1000 ran¬ 
domly chosen initial conditions in each sample (top figure) 
and N = 100, 000 randomly chosen initial conditions in each 
samples (bottom figure). The solid curve shows the mean of 
the 100 samples, and the error bars show their standard devi¬ 
ation. As we discussed in Sec. m the slope of the solid curve 
should, in the limit of large N and T, approximate Ho(f, S'). 
The dashed line has slope In 2, which is the value we obtained 
analytically for Ho(f, S'). 


0 t+ 1 = [0 t + a t + K sin 6 t \ mod 27r ( 8 ) 

where K > 0 and ao,a 1 , 0 : 2 ,... are independent ran¬ 
dom variables that are uniformly distributed in the circle 
[0, 2tt). We take the restraining region S to be the entire 
circle. 

Notice that 

T-l 

= JJ |1 + K cos 6 t |, 
t =0 

and that 


where (■••),, denotes an average over 77 . If 9q is uniformly 
distributed, then 60 , 61 , 62 , ■■ ■ are independent and uni¬ 
formly distributed, so that 

T-l 

{\ddr/ddo\)e a ^ 1 ,...,e T _ 1 = (|1 + Kcos 6 t \)e t 

t=o 

= (|1 + K cos9\)J 

This suggests that for a typical realization of the random 
inputs, Hq « A, where 


ddx 

d 6 0 


E t , 0 = {max(\d6 T /d6o\,l))e 0 , 


A = ln(|l + K cos0|)g. 
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N = 1000 



N = 100000 



FIG. 3. Computation of In St versus T for the map of Fig. [I] 
with restraining region S. This is the analogue of Fig. [2] with 
S' replaced by S. 

For 0 < K < 1, 

A = ln((l + K cos 0))e = lnl = 0, 
while for K > 1, 

A = ln( 11 + K cos0| — (1 + K cos 9) + 1)# > In 1 = 0. 


For 0 < K < 1, each map is a diffeomorphism, so 
ddt/d6 o > 0, and 

Et ,o = (ma,x(d9T/ddo, l))e < (ddr/ddo + l)g 0 = 2. 


Thus, Et ,o is not exponentially increasing, so indeed 
H 0 = 0 for 0 < K < 1. Numerical experiments agree 
with the argument above that Hq > 0 for K > 1, though 
establishing that the transition to chaos (according to 
our definition) occurs exactly at K = 1 would require a 
more definitive stud y. I n Fig . [4j we show the computed 
In St (see Sec. IIC and 


III B) versus T for K = 1.5. 



FIG. 4. Computation of In Et versus T for the random circle 
map ji]) with K = 1.5. For each T, we computed In Er{f, S) 
for 100 different samples, with N = 1, 000, 000 randomly cho¬ 
sen initial conditions in each sample. Each initial condition 
used a different realization of the random sequence of maps. 
The solid curve shows the mean of the 100 samples, and the 
error bars show their standard deviation. The dashed line 
has slope In(11 + 1.5cos#|)e; this estimate of the expansion 
entropy appears to be slightly larger than the slope of the 
computed data. 


D. Example: Shear map on the 2-torus 

This example illustrates a case where orbits are dense 
and, as in chaos, typical nearby orbits separate from each 
other with increasing time. However, the rate of sepa¬ 
ration is linear, rather than exponential in time. The 
example is the following map of the 2-torus: 

</>t +i = \(t>t + 0t\ mod 2 tt, 6 t+1 = [0 t +u] mod 2 tt, (9) 

where is irrational—- l As shown in Fig. [5j the 

image under this map of a curve C looping around the 
0 , </>-torus once in the 9 direction is a curve C' that loops 
once in the direction, as well as once in the 8 direction, 
with the number of <fi loops increasing by one on each 
subsequent iterate. Orbits are dense and nearby initial 
conditions with different values of 9 separate linearly with 
t. To evaluate H 0 for this map from the definition Eq. 
with the restraining region S being the entire torus, we 
note that 

= ( J J ) and Df v<t = ( J *' ~ * ) 

for all (f> and 9. For f-i > 1, the singular values of 
Dft>,t are approximately t' — t and (t' — t)~ l . Thus, for 
large t' — t, 

E t g t (/,5)«(27T) 2 (t'-t), 

and Hq = 0 (since (f — t ) _1 log(t' — t) — > 0 as t' —> 
oo). Hence this example is not chaotic according to our 
definition. 
















































FIG. 5. Image C' of a circle C given by <f> = constant under 
the shear map Q. 



FIG. 6. A horseshoe map / that is linear for trajectories that 
remain in the restraining region S. 


E. Example: Horseshoe and Henon map 

Figure [6] shows the action of a horseshoe map in the 
plane on a unit square S', which we also take to be the 
restraining region. The step (a) —> (b) represents a uni¬ 
form horizontal compression and vertical stretching of 
the square. Let p > 2 be the ratio by which the ver¬ 
tical length of the square is stretched, and assume that 
bending deformations in the step (b) —>• (c) take place 
only in the shaded region. The fraction of the orig¬ 
inal square that remains in the square after one iter¬ 
ate is 2Ip (see Fig. [h](d)), and after t' — t iterates, the 
fraction is (2/p) t '~ t . Also, G(Df t p t ) = // -t , yielding 
S) = P t '- t (2/p) t ’- t = 2 t '~ t , and H 0 = In 2. Thus, 
by our definition the horseshoe map is chaotic in S. 

For the Henon map 


FIG. 7. Computation of In Ft versus T for the Henon map 
with a = 4.2 and b = 0.3. For each T, we computed 
\nEr{f, S) for 100 different samples, with N = 100, 000 ran¬ 
domly chosen initial conditions in each sample. The solid 
curve shows the mean of the 100 samples, and the error bars 
show their standard deviation. The dashed line has slope 
H 0 = In 2. 


with b = 0.3, the results of Devaney and Nitecki® imply 
that for a > 3.4, the map has a topological horseshoe, 
and for a < 5.1, the nonwandering set is contained in the 
square — 3 < x, y < 3, which we take to be the restraining 
region S. Fig. [7] shows the results of a n um erical compu- 
tation for a = 4.2 of In Et (see Sec. IIC and III B) versus 


T, which agrees well with the value Hq = In 2. 


IV. TOPOLOGICAL ENTROPY 


In this section, we define topological entropy , and dis¬ 
cuss its relation to (and equivalence with, in appropriate 
circumstances) both expansion entropy and the related 
notion of volume growth. 

The original definition of topological entropy, by Adler, 
Konheim, and McAndrew^, was for a continuous map 
/ on a compact topological space X. If X is a met¬ 
ric space, an equivalent definition of topological entropy 
due to DinaburgSU and BowerP^ is as follows. (Equiva¬ 
lence to the original definition was proved by Bowen®.) 
For e > 0, two points x and y in X are called (T, e)- 
separated if the distance between their fcth iterates sat¬ 
isfies d(f k (x), f k (y)) > e for some 0 < k < T. A finite 
set of points P C X is said to (T, e)-span X if there is no 
point in X that is (T, e)-separated from every point in P. 
Let n(T, e) be the minimum number of points needed to 
(T, e)-span X, and let N(T,e) be the maximum number 
of points in X that can be pairwise (T, e)-separated. Let 

h n (f,e) = limsup 

T—>oo 


x t +i =a + by t -Xt, y t + i = x t 


T 
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and 

h N (f,£) = limsup —— 7 ^—^. (!0) 

It is not hard to show that n(T, e) < N(T, e) < n(T , e/2). 
This implies the analogous relation between h n and /ijv, 
which implies that they have the same limit as e —> 0. 
Define the topological entropy h of / on A' by 

h(f,X) = lim h n (f,e) = lim h N (f,e). (11) 

e —>0 e —>0 

The notions of expansion entropy H Q and topological 
entropy h are both well-defined in the case when / is a 
smooth, autonomous system on a compact manifold M 
and the restraining reg ion S is all of M. In this case, 
Sacksteder and ShutPS defined a quantity they called hi 
that is equivalent to expansion entropy. Subsequently, 
PrzytyckJ^ proved that hi is an upper bound on h if 
/ is a C 1+7 diffeomorphism for 7 > 0; this proof was 
extended to noninvertible maps by Newhouse 46 . Though 
there are examples 4 ‘ I for which the two quantities differ, 
Kozlovski 2 ' proved that hi = h for C°° maps. Thus, 
H 0 (f,M) = h(f,M) for a sufficiently smooth map / on 
a compact manifold M. 

From our point of view, these results leave open con¬ 
sideration of important issues regarding nonautonomous 
systems and the role of restraining regions. For exam¬ 
ple, suppose now that J is a compact invariant set of 
an autonomous system / on a (not necessarily compact) 
manifold M. If J has volume zero, Ho(f 1 J ) is undefined, 
but we can define H 0 for a neighborhood 5 of J that con¬ 
tains no other invariant sets. In this case, we conjecture 
that H 0 (f, S ) = h(f, J ) if / is C°°. More generally, when 
the restraining region S contains multiple invariant sets, 
we conjecture (consistent with Eq. <©) that H 0 (f,S) is 
the maximum topological entropy of / on an invariant 
subset of S. 

Our notion of expansion entropy is related to the 
notion of volume growth defined by Yomdin— ! and 
Newhouse^. Yomdin defines the exponential rate Vd{f) 
of d-dimensional volume growth of a smooth map / on a 
compact manifold M, and proves that Vd(f) < h(f, M ) if 
/ is C °°. Newhouse defines the volume growth rate more 
generally for a neighborhood U of a compact invariant 
set J C M, and proves that h(f , J) is bounded above by 
the maximum over d of the d-dimensional volume growth 
rate on U. See also Gromov^ for a discussion of these 
results. 

Based on these results, Newhouse and Pignataro^® 
proposed and implemented algorithms for computing 
entropy of two-dimensional diffeomorphisms (including 
Poincare sections of three-dimensional differential equa¬ 
tions) by computing the exponential growth rate o f the 
length of an iterated curve. Other algorithms ) 51 * 52 ! com¬ 
pute the growth rate of the number of disconnected arcs 
resulting from the iteration of an initial line segment 
within a neighborhood of a two-dimensional chaotic sad¬ 
dle or repeller. Of course, these methods could be ex¬ 
tended to higher dimensions by considering growth of 


surface areas, etc. Expansion entropy, by estimating vol¬ 
ume growth locally, allows an analogous computation to 
be done without having to compute and measure mul¬ 
tidimensional surfaces. It is analogous to the approach 
used by Jacobs et alP^ for two-dimensional maps. 

Another approach to computing entropy is by symbolic 
dynamics: partition the state space into numbered sub¬ 
sets, and estimate the exponential growth rate (as time 
increases) of the number of different sequences of sub¬ 
sets that can be visited by a finite-time trajectory. This 
approach can yield good estimates with wcll-chosen par¬ 
titions, but inadequate partitions may lead to underesti¬ 
mation, and in some cases symbolic dynamics indicates 
positive entropy when the topological entropy is actually 
zeroPSO 

We conclude this section with a brief discussion of 
the connection between the definitions of expansion en¬ 
tropy and topological entropy in the case of a smooth, 
autonomous system on a compact manifold M, with re¬ 
straining region S = M. In Appendix [Bj we argue that 
for sufficiently small e > 0, the quantity Er,o(f,S) of 
Eq. ([!]) approximates N(T,e)/N( 0, e), where N(T,e) is 
the maximum number of trajectories that are a distance e 
apart at either time 0 or at time T. Note that N(T, e) is a 
lower bound on N(T, e), because the latter distinguishes 
between trajectories that are e apart at some time be¬ 
tween 0 and T; however, at least for hyperbolic systems 
the difference between N and N should be inconsequen¬ 
tial. Eqs. (101 and (11) first take a limit with respect to 
T and then e. Normalizing by iV(0,e) does not change 
the limit: 


h(f,S) = lim lim sup 

e->0 T^-oo 


= lim lim sup 

e->0 T^-oo 


In IV (T, e) — In A r (0, e) 
T 

hi(N (T, e)/iV(0, e)) 

T 


( 12 ) 


We have argued above that 


Er,o{f,S) = lim 


N(T,e) 


e^o N{ 0, e) ' 


Thus, by Eq. ([ 2 ]), the definition of Ho differs from the def¬ 
inition of h primarily because it uses N(T,e) < N(T,e ), 
and because the limits with respect to T an e are taken 
in the reverse order. 


V. DEFINITIONS OF CHAOS THAT DO NOT INVOLVE 
ENTROPY: SENSITIVE DEPENDENCE, LYAPUNOV 
EXPONENTS AND CHAOTIC ATTRACTORS 

A concept often associated with chaos is that of sensi¬ 
tive dependence, the idea that the orbits from two nearby 
initial conditions can move far apart in the future. In 
the mathematical literature the most common definition 
of “sensitive dependence” is as follows. (This definition 
is also sometimes called “weak sensitive dependence.”) 
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Definition: A continuous map, / : M — > M , on the 
compact metric space M has sensitive dependence if there 
exists a p > 0 such that for each S > 0 (no matter how 
small) and each x £ M, there is a y £ M that is within 
the distance S of x and for which at some later time t, 
\f(x) - f(y) | > p. 

That is, no matter how close together the initial condi¬ 
tions x and y are, if we wait long enough, the orbits from 
these initial conditions will separate by more than some 
fixed value p. Notice that this definition of sensitive de¬ 
pendence does not say anything about the rate at which 
these orbits diverge from each other: this rate might, for 
example, be exponential (e.g., as for situations with a 
positive Lyapu nov ex ponent), or linear (e.g., as for the 
example in Sec. HID). 


Another often used concept assigns sensitive depen¬ 
dence to the dynamics on a compact invariant set (the 
space M is now not necessarily compact) as follows. 

Definition: A continuous map / has sensitive depen¬ 
dence on a compact invariant set J of a metric space M 
if for every 5 > 0 (no matter how small) and every point 
x £ J, there is a point y £ J within a distance 6 of x 
such that, at some later time t, |/*(:r) — f t {y)\ > p for 
some fixed value p > 0. 

The following is a definition of chaos, based on that 
given by Devanej^. 

Definition of Devaney-chaos: A continuous map 
/ : M —> M, with M a compact metric space, is chaotic 
if it satisfies the following three conditions. 

(i) / has sensitive dependence. 

(ii) / has periodic orbits that are dense in M. 

(iii) / has an orbit that is dense in M, i.e., there exists 
an initial condition x* such that for each y £ M and 
each S > 0 (no matter how small), at some time t, 
the orbit from x* will be within the distance 6 from 
y: | fix*) —y\<5. 

This definition can be converted to define Devaney 
chaos for a compact invariant set, J = f(J), by replacing 
M in conditions (ii) and (iii) by J, and condition (i) by 
“/ has sensitive dependence on J”. 

It was pointed out by Banks et alP^ that conditions 
(ii) and (iii) of Devaney’s definition, imply his condition 
(i). Thus condition (i) for Devaney-chaos can be omit¬ 
ted. A serious drawback of Devaney’s definition of chaos 
is that it excludes significant cases that are sometimes 
considered and that most would regard as chaotic. For 
example, consider a map with quasi-periodic forcing, 

z t+ i = G(zt, 0 t ), 9 t+ i = [0 t + w] mod 2 tt, (13) 

where uj/(2tt) is an irrational number. Regarding this 
as a dynamical system with a state x = {z,0), we see 
that, because of the quasi-periodic behavior of 0, there 
are no periodic orbits of this system. Hence, the system 
(131 fails condition (ii) for Devaney chaos. Thus accord¬ 


can never exhibit chaos. Yet quasi-periodically forced 
systems are of practical interest and can have attractors 
with a positive Lyapunov exponent, a situation generally 
thought of as chaotic. Another point to make in connec¬ 
tion with the example (13) is that it presents a problem 


for the Devaney definition of chaos even when G is in¬ 
dependent of 9: in that case z t + 1 = G{z t ) 1 on its own, 
might indeed satisfy the conditions for Devaney-chaos; 
however, by considering the state to be x = (z, 6) with 
0t quasi-periodic, the Devaney chaos condition (ii) is not 
satisfied, even though there is no change in the chaotic 
dynamics of z. 

According to Banks et al., Devaney-chaos only requires 
satisfaction of the two conditions that there be a dense 
orbit and a dense set of periodic orbits. Robinson^, on 
the other hand, notes that of the three conditions origi¬ 
nally specified by Devaney, the requirement of a dense set 
of periodic orbits does not seem as “central to the idea of 
chaos” as the other two conditions (sensitive dependence 
and a dense orbit). Thus he (and also, independently, 
Wiggind^j) proposes the following definition. 

Definition of Robinson-chaos: The same as 
Devaney-chaos except that condition (ii) is deleted. 

This definition, by not requiring periodic orbits, has 
the benefit of potentially allowing more consistent treat¬ 
ment of forced systems, like (13). However, there is 


still, in our opinion, a drawback. This occurs, e.g., with 
reference to the shear map example (U of Sec. |hTL) 1 
which was considered by RobinsorPS (see also Hunt and 
OtlP). As discussed in Sec. f" 


HID 


orbits are dense and 
nearby points typically separate linearly with t. Thus, 
this example is Robinson chaotic. However, the two Lya¬ 
punov exponents are zero. While this example satisfies 
the Robinson-chaos definition, due to the slow, linear-in¬ 
time, separation of orbits, such dynamics has previously 
been classified as nonchaotic (see literature on so-called 
strange nonchaotic attractors 13 ). Indeed, this linear-in¬ 
time separation of nearby orbits presents comparatively 
little prediction difficulty as compared to the exponential 
divergence emphasized by Lorenz. 

Li and Yorkd^ define the notion of a “scrambled set”, 
and the presence of a scrambled set can be taken as an¬ 
other definition of chaos. While this works well in the 
original context of one-dimensional maps considered by 
Li and Yorke, as we will see, it is not as appropriate for 
higher dimensional systems. 

Definition of a scrambled set: For / : M —> M 
with M a compact metric space, an uncountably infinite 
subset J of M is scrambled if, for every pair x,y £ J 
with x ^ y, 


lim sup |/* (ie) - f{y) | > 0, 

£—>•00 


lim inf | f(x) - f{y)\ = 0. 

£—>•00 


ing to the definition of Devaney chaos, a system like (13) 


Thus, by the second Li-Yorke condition, the orbits 
from x and y come arbitrarily close to each other an 
infinite number of times, while by the first Li-Yorke con¬ 
dition, the distance between the orbits from x and y also 
exceeds a fixed positive amount an infinite number of 
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times. An attractive aspect of scrambling is that it ex¬ 
cludes some cases that have sensitive dependence but are 
usually not considered chaotic. In particular, the shear 
map example discussed above does not have a scram¬ 
bled set because the 0-distance (or ^-distance, if the 0- 
distance is 0) between a pair of orbits remains constant, 
thus violating the second Li-Yorke condition for scram¬ 
bling. Nevertheless, as with Robinson-chaos, the defi¬ 
nition of chaos as having an uncountable scrambled set 
includes cases that are generally regarded as nonchaotic. 
One example is a two-dimensional flow with an attract¬ 
ing homoclinic orbit, considered by RobinsorPS and W. 
Ott and York^® 7 (see Figure 1 in either paper); on a tra¬ 
jectory converging to the homoclinic orbit, a finite piece 
of the trajectory forms an uncountable scrambled set. 
Thus, the compact invariant set formed by the homo¬ 
clinic orbit and its interior exhibits scrambling. 

From the discussion above, we see that using notions 
related to the common definition of sensitive depen¬ 
dence presents problems when attempting to use them 
to give a generally applicable definition of chaos. On the 
other hand, another type of dynamical characterization, 
namely that of Lyapunov exponents, seems better suited 
to defining chaos. Indeed, it can be quite useful to define 
a chaotic attractor using Lyapunov exponents. If one ex¬ 
cludes certain cases of Milnor attractors (see below) and 
concentrates on a definition of an attractor of a map / 
as a bounded set A with a dense orbit such that there 
is an e-neighborhood A f for which n^ =0 f t (A e ) = A, then 
it seems that a good definition of a chaotic attractor of 
the map / is simply an attractor that has a positive Lya¬ 
punov exponent. 

Now, however, consider Milnor’s definition 58 of an at¬ 
tractor: A is an attractor for f : M M if there is a 
positive Lebesgue measure of points x £ M such that A 
is the forward time limit set of A. Figure [8] shows an 
example demonstrating that the definition of a chaotic 
attractor as an attractor with a positive Lyapunov ex¬ 
ponent can be problematic, if Milnor’s definition of an 
attractor is used. 

The function f(x) in Fig.[8]goes to zero at x = ±1 and 
remains zero for \x\ > 1. There is a positive measure of 
initial conditions Xq that go to x = 0 and stay there (e.g., 
if a < Xo < b, then x\ > 0 and £2 = £3 = £4 = ■ • • = 0). 
Thus, the unstable fixed point x = 0 is a Milnor attractor 
with a positive Lyapunov exponent (because df /dx > 1 
at x = 0) yet it would be, we think, unacceptable to call 
the set x = 0 chaotic. This example is rather special and 
contrived. Thus, in practice, it is still very useful to think 
of a chaotic attractor as one with a positive Lyapunov 
exponent. However, a main concern of this paper is a 
definition of chaos that works fairly generally, including 
being applicable to both attractors and repellers. In the 
case of repellers, basing the existence of chaos on Lya¬ 
punov exponents presents a problem, since a repelling 
fixed point with a positive Lyapunov exponent could not 
reasonably be considered chaotic. On the other hand, 
the anomaly for the fixed-point repeller example and the 



FIG. 8. A one-dimensional map for which the unstable fixed 
point at x = 0 is a Milnor attractor. Trajectories that reach 
[a, b] map to 0 two iterates later. 


Milnor example of Fig. [8] is removed if we define chaos 
by positive expansion entropy (see, e.g., Sec. Ill A). 


VI. CONCLUSION 


In this paper we have introduced a quantity, the ex¬ 
pansion entropy (Eqs. |l]) and §)> and we have argued 
that expansion entropy provides a “good” definition of 
chaos in that it possesses several desirable properties. We 
also compare this definition with other past definitions of 
chaos (Secs. IV and[v|). In particular, the expansion en¬ 
tropy H 0 enjoys the properties of generality, simplicity, 
and computability discussed in Sec. [TJ One important fea¬ 
ture of Hq is that it assesses the presence of chaos in any 
given bounded region S in state space, rather than in an 
invariant set. As such, it applies naturally in cases where 
the invariant sets are unknown or (e.g., in both deter¬ 
ministically and randomly forced systems) do not exist. 
Section |lII C| presents examples illustrating various issues 
and features of expansion entropy, perhaps most impor¬ 
tantly its numerical computation. It is our hope that 
our paper will lead to the use of expansion entropy in 
applications and to further study of its properties. 
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Appendix A: q-Order Expansion Entropy 


As discussed in Sec. |IID[ we here generalize our defi¬ 
nition of Hq to a definition of a q-order entropy H q : 


1 


H q = , 

1 - q t' 


lim —- 

oo t — t 


In ■ 


h,, t Gl - qd » ' 


(Al) 


where the argument of G is the same as in Eq. ( |Tj). C om- 
paring Eqs. and with ( |A1[ ), we see that ( |Al| re¬ 
duces to ([l]) and ([2]) for q = 0. Furthermore, letting 
q —► 1 and assuming that the q —> 1 and t — > 00 limits 
can be interchanged, we obtain 


H 1 = 


Inn —- - —r— 

t'-t 00 t' — t ) 


1 


1 

T+ 


~ (A2) 


where, as in Sec. m 


— = lim —— 
T_|_ t r —^00 t, — t 


In 


( »(S) 


The quantity (A2) can be viewed as bearing a relation¬ 


ship to metric entropy that is analogous to the relation¬ 
ship between H 0 and topological entropy. In the case 
where S contains an attractor, l/r+ = 0. In the case 
where S contains a repeller, we call r + the average life¬ 
time of repeller orbits. In the case where S' is a neigh¬ 
borhood if an invariant set with a “natural measure”®, 


we can identify the first term in Eq. (A2) with the sum 
of the positive Lyapunov exponents \f. 


H, 


= s Lj X j- V r +> 


(A3) 


A>0 


which agrees wit h th e results for metric entropy of Kantz 
and Grassbergei^® for chaotic repellers and of Pesin 37 
for I/7+ = 0. 

We now ob tain H q (f, S) and H q {f, S') for the example 
in Sec. |IIIB where S is the large interval [—1,1.5] con¬ 
taining both the attracting fixed point and the chaotic 
repeller, while S' G S is the smaller restraining region 
[0,1] containing only the chaotic repeller. 

We beg in by finding H q (f,S'). As discussed in 
Sec. Ill B the set S? 0 of initial conditions that remain in 
S' from time 0 to time T consists of 2 T initial intervals of 
varying widths 3~ k 2 k ~ T (where k = 0,1,..., T) on each 
of which G(Df T ) = 3 k 2 T ~ k . In addition, the number of 
such intervals with a given k is the binomial coefficient 
C(T, k) = T\/[k\(T - m. Thus, the integral of G 1_<? 
that appears in Eq. (All is 


f G(Df T y- q dn = ^2 C ( T ’ ^)[3 fc 2 T-fe ] 1-9 3 -fe 2 fe-r 

J S t, 0 k— 0 


= (3~ q + 2~ q ) T . 


(A4) 


Furthermore, the total length of S' T0 decreases by the 
ratio 5/6 upon increase of T by one, so that 


M'S’t.o) — (5/6) 3 


(A5) 


Using Eqs. (|A4[) and (A5) in Eq. ([!]), we obtain 


H q (f, S') = (1 - q)- 1 ln[(2/5) 9 + (3/5) 9 ]. (A6) 

Note that this quantity is positive for all q > 0, and 
decreases monotonically with increasing q (dashed curve 
in Fig. 9|. Fo r q = 0, this agrees with our previous result 
of Sec. IIIB that S') = In 2, while taking the limit 

q -> 1 yields Efi(/,S") = (2/5)ln(5/2) + (3/5)ln(5/3) > 
0. As q —> 00, H q (f,S') -t ln(5/3), so that H 0 = In2 > 
H q >H 00 = ln(5/3). 

We now turn to the evaluation of the q-order expansion 
entropy for the larger restraining region S = [—1,1.5]. 
The main difference from S' is that St,o = S for all 
T > 0, so (i(St,o) = 2.5, in contrast with Eq. ( |A5| ). To 
estimate the integral of G(Df T ) 1 ~ q over St o, note first 
that by Eq. 


! St a 


G(D/ J r^> / G^Df 1 ) 1 -^ 


= (3 _<? + 2~ q ) T . 

The contribution to the integral of G(Df T ) 1 ~ q from ini¬ 
tial conditions in St ,0 but not in S' T0 can be bounded 
above by CT max[(3 -9 + 2 ~ q ) T , 1] for a constant C inde¬ 
pendent of T ; the factor of T in the upper bound comes 
from considering trajectories that first leave S' at time 
t, for each of the values t = 0,1,..., T — 1. Also, since 
G(Df T ) = 1 for initial conditions in the interval near 
x = —1/2 on which Df < 1, such initial conditions con¬ 
tribute at least c > 0 to the integral, where c is the length 
of the contracting interval. Thus, 


■+{3~ q + 2~ q f < f G{Df T ) l ~ 
J St, 0 


q dfl 


< CT max[(3 -9 + 2~ q ) T , 1], 


From Eq. (Al), recalling that h(St, 0) = p-(<S'), we con¬ 
clude that for q ^ 1, 

H q {f, S) = (1 - q)- 1 Inmax(3 -9 + 2“ 9 ,1). (A7) 

Note that there is a critical value 0 < q c < 1 for which 
3 -9c + 2~ q ° = 1; then H q (f,S) = 0 for q > q c . In 
particular, H\(f , S) = 0 by taking the limit q —> 1. 
Comparing Eqs. (|A6|) and (|A7|), we se e tha t 


H 0 (f,S') = H 0 (f,S) = ln2 (as we argued in Sec. IllCI, 
but H q (f , S') > H q (f , S) for q > 0; see Fig. [9] Note also 
that if the slopes 3 and 2 were increased, the critical value 
q c beyond which H q (f, S) = 0 could be made arbitrarily 
close to 0. We conclude that H q for q > 0 does not al¬ 
ways detect chaos (i.e., H q may be zero) in a restraining 
region containing an invariant set that is chaotic by all 
the definitions we reviewed in Sec. [Vj as well as by our 
definition H 0 > 0. 


Appendix B: Relation of Expansion Entropy Integral to 
Topological Entropy Ratio 

Here we justify the claim in Section [IV] that the integral 
Et, o(/, S) of Eq. (Til used to define expansion entropy ap- 
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FIG. 9. H q (f,S') (dashed curve) and H q (f,S) (solid curve) 
versus q. The dashed curve decreases slightly from In 2 ss 
0.693 at q = 0 to about 0.663 at q = 1.5. 

proximates, for small e, the ratio N(T,e)/N( 0, e) related 
to the definition of topological entropy. Below, when we 
say that two quantities have the “same order of mag¬ 
nitude” , we mean that their ratio is bounded above and 
below by positive constants that are independent of e and 
T. 

Assume that e > 0 is small enough that the remainder 
term in the first order Taylor expansion of /t,o is much 
smaller than e for points within e of each other: 

\fr,o(y) - It, o(x) - Df T ,o(x)(y - x)\ < e 

for x,y £ S with \y — x\ < e. Cover S with a grid of 
Nq boxes whose diameters are e; then No has the same 
order of magnitude as the maximum number N(0, e) of 
e-separated points in S. Each box B is contained in a 
ball of radius e, and contains a ball whose radius has 
the same order of magnitude as e. Notice also that 
y{B) ss y(S)/N 0 for small e. Let a: B be the center of 
B , and let a\ > 02 > ■ • • > a n be the singular values of 
DfT,o(xB)- Then the image of B under fx.o contains and 
is contained in ellipses whose semiaxes have the same or¬ 
der of magnitude as aye, aye • ■ •, cr n e. Let d be the largest 
index for which ad > 1. Then the maximum number of 
e-separated points in the image of B has the same order 
of magnitude as oyay • • • era = G(D Jt^xb))- Summing 
over all B, the maximum number N(T, e) of trajectories 
that are e-separated at either time 0 or at time T has the 
same order of magnitude as 

Y i G{Df Ti0 {x B )) « j s G(Df Tt0 (x))dy(x) 

~ J s G< ^ D fBo{x))dy{x) 

Since we assumed that S is invariant, St,o is the same 
as S. Comparing with Eq. (|T|, the discussion above con¬ 


stitutes an outline of a proof that N(T,e)/N(0,e) has 
the same order of magnitude as ET,o(f,S). (In fact, the 
same is true when S is not invariant, if we define N to 
count only trajectories that remain in S between times 0 
and T.) 
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